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Abstract 
We  study  the  problem  of  optimal  consumption  choice  in  continuous  time  under  certainty  for 
a  class  of  utility  functions  that  capture  the  notion  that  consumptions  at  nearby  dates  are  almost 
perfect  substitutes.  The  class  we  consider  excludes  all  time-additive  and  almost  all  the  non  time- 
additive  utility  functions  used  in  the  bterature.  We  provide  necessary  and  sufficient  conditions 
for  a  consumption  policy  to  be  optimal.  Furthermore,  we  demonstrate  our  general  theory  by 
solving  in  a  closed  form  the  optimal  consumption  policy  for  a  particular  felicity  function.  The 
optimal  policy  in  our  solution  consists  of  a  (possible)  initial  "gulp"  of  consumption,  or  an  initial 
period  of  no  consumption,  followed  by  consumption  at  the  rate  that  mountains  a  constant  ratio 
of  wealth  to  average  past  consumption. 


*We  are  grateful  to  Hua  He  for  pointing  out  an  error  in  an  earlier  version,  and  to  John  Heaton,  Jean-Luc  Vila 
and  Thaleia  Zariphopoulou  for  helpful  discussion. 


1     Introduction 

The  choice  of  an  optimal  consumption  plan  for  an  individual  under  certainty  is  a  classical 
problem  in  economics;  see,  for  example,  Ramsey  (1928)  and  Modigliani  and  Brumberg  (1954). 
In  a  large  part  of  the  literature  that  addresses  this  problem,  the  preferences  of  an  individual  are 
represented  by  a  time-additive  utility  function.  It  has  long  been  recognized  that  a  time-additive 
utility  function  does  not  incorporate  the  intuitively  appealing  notion  that  past  consumption  can 
contribute  to  an  individual's  future  satisfaction.  Nevertheless,  this  class  of  preferences  has  been 
utilized  because  of  its  tractability.  In  discrete  time  models,  one  can  argue  that  if  the  length 
of  time  periods  is  chosen  appropriately,  then  past  consumption  would  have  negligible  effect  on 
current  satisfaction.  Such  arguments,  however,  no  longer  apply  when  we  consider  a  continuous 
time  model. 

Recently,  a  class  of  non-time-additive  utility  functions,  due  originally  to  Koopmans  (1960) 
and  Uzawa  (1968),  has  gained  increasing  significance  in  the  literature  of  continuous  time  equi- 
librium models;  see,  for  example,  Epstein  (1987).  Also,  non-time-additive  utility  functions  that 
exhibit  habit  formation  are  objects  of  current  research  interest  in  continuous  time  financial  asset 
pricing  models;  see,  for  example,  Constantinides  (1988),  Heaton  (1988),  and  Sundaresan  (1989). 
A  common  feature  of  these  utility  functions  is  that  the  felicity,  or  the  index  of  instantaneous 
satisfaction  at  any  time,  is  a  function  of  the  current  consumption  and  a  certain  functional  of 
the  past  consumption.  A  high  level  of  past  consumption  can  serve  either  to  depress  current 
appetite  as  in  the  case  of  the  Uzawa  type  utility  functions  or  to  increase  current  appetite  as  in 
the  case  of  the  habit  formation  models. 

These  non-time-additive  utility  functions  offer  intuitively  appealing  notions  of  interactions 
between  past  and  current  consumption.  They  are  also  mathematically  tractable.  Optimal  con- 
sumption policies  can  be  characterized  using  dynamic  programming.  For  particular  functional 
forms  of  the  felicity  function,  one  can  even  have  closed  form  expressions  for  these  policies. 
Unfortunately,  these  utility  functions  fail  to  exhibit  one  key  economic  property  that  underlies 
much  of  our  intuition  about  the  behavior  of  asset  prices  over  time  in  the  absence  of  arbitrage 
possibiUties. 

A  common  hypothesis  maintained  by  many  financial  economists  is  that  asset  prices  cannot 
have  predictable  jumps.  To  support  this  hypothesis,  the  argument  goes  as  follows:  suppose 
agents  knew  that  the  price  of  an  asset  were  to  increase  by  a  discrete  amount  at  a  specific 
moment.  If  an  agent  could  borrow  funds  for  a  very  short  period  of  time  over  which  the  interest 
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he  would  have  to  pay  is  negligible,  then  he  would  be  able  to  realize  an  "arbitrage  profit".  Having 
access  to  a  frictionless  market,  he  would  simply  borrow  some  funds  just  before  the  jump  in  the 
price  were  supposed  to  occur,  buy  the  asset,  wait  for  its  price  to  increase,  and  then  liquidate  his 
"position.  The  demand  of  agents  exploiting  this  arbitrage  opportunity  would  push  the  price  of 
the  asset  up  before  the  time  when  the  jump  were  supposed  to  appear  and  hence  the  jump  would 
be  eliminated.  The  validity  of  this  argument  depends  crucially  on  the  hidden  assumption  that 
prices  for  consumption  at  nearly  adjacent  dates  are  almost  equcd  and  thus  the  interest  that  the 
agent  pays  on  funds  borrowed  over  a  short  time  interval  is  negligible. 

There  are  several  economic  forces  that  will  bring  about  the  closeness  of  prices  for  consump- 
tions at  nearly  adjacent  dates.  The  most  primitive  among  these  forces  is  the  hypothesis  that 
agents  treat  consumptions  at  nearly  adjacent  dates  as  almost  perfect  substitutes  and  thus  en- 
sure that  almost  equal  prices  are  established  for  them.  Huang  and  Kreps  (1989),  in  a  model 
under  certainty,  and  Hindy  and  Huang  (1989),  in  a  model  under  uncertainty,  study  prefer- 
ences that  exhibit  this  property.  They  show  in  particular  that  if  the  felicity  function  depends 
explicitly  on  current  consumption  and  is  strictly  concave  in  it,  then  consumptions  at  nearly 
adjacent  dates  cannot  be  treated  as  almost  perfect  substitutes.  Since  the  functional  forms  of 
the  felicity  function  used  both  in  the  Uzawa  type  and  in  the  habit  formation  type  preferences 
are  strictly  concave,  agents  with  those  preferences  do  not  view  consumptions  at  nearby  dates 
as  close  substitutes.^  Therefore,  such  models  will  reach  economic  conclusions  that  violate  some 
of  our  basic  intuition  about  price  behavior  over  time. 

The  purpose  of  this  paper  is  to  investigate  the  optimal  consumption  problem  under  certainty 
for  a  class  of  utility  functions  that  treat  consumptions  at  nearby  dates  as  close  substitutes.  The 
key  feature  of  this  class  of  utility  functions  is  that  the  felicity  function  at  any  time  depends  only 
upon  an  exponentially  weighted  average  of  past  consumption  -  one  derives  satisfaction  only  from 
past  consumption.  We  will  demonstrate  the  tractabihty  of  this  family  by  showing  how  dynamic 
programming  can  be  used  to  give  sufficient  conditions  for  optimality.  In  particular,  for  a  specific 
functional  form  of  the  felicity  function,  we  solve  in  closed  form  the  optimal  consumption  policy. 

Intuition  suggests  that  when  one  derives  current  satisfaction  only  from  past  consumption, 
the  optimal  consumption  policy  may  specify  periods  of  consumption  mixed  with  periods  of 
no  consumption.  Our  closed  form  solution  exhibits  this  property.  In  particular,  the  optimal 
consumption  policy  in  our  solution  calls  for  a  (possible)  initial  "gulp"  of  consumption,  or  an 


'Heaton  (1990)  studies  preferences  in  discrete  lime  whose  continuous  time  limits  satisfy  the  notion  of  local 
substitution  studied  by  Huang  and  Kreps  (1989)  and  Hindy  and  Huang  (1989). 


initial  period  of  no  consumption,  followed  by  consumption  at  the  rate  that  maintains  a  constant 
ratio  of  wealth  to  average  past  consumption.  The  consumption  rate  is  determined  by  the 
interplay  between  the  effect  of  past  consumption,  the  current  return  on  investment  and  the 
impatience  of  the  agent. 

The  rest  of  this  paper  is  organized  as  follows.  Section  2  sets  up  the  consumption  problem 
under  certainty  in  continuous  time.  Section  3  heuristically  derives  necessary  conditions  for  a 
consumption  policy  to  be  optimal.  Section  4  provides  sufficient  conditions  for  optimality.  In 
section  5,  we  solve  the  optimal  consumption  problem  in  closed  form  for  a  particular  felicity 
function.  Section  6  contains  concluding  remarks. 

2    The  Setup 

Consider  an  economic  agent  who  lives  from  time  t  =  0  to  <  =  T  in  a  certain  world  where  there 
is  a  single  consumption  good  available  at  any  time  between  0  and  T.  The  agent  can  consume 
"gulps"  of  the  good  at  any  moment,  and  can  consume  at  finite  rates  over  intervals.  He  can  also 
refrain  from  consumption  for  any  period  as  he  sees  fit.  We  represent  the  agent's  consumption 
pattern  over  his  life  span  by  a  positive^,  increasing,  right  continuous  function  C:[0,T]  — ►  ??+, 
with  C{i)  denoting  the  accumulated  consumption  from  time  zero  to  time  t.  Note  that  the  only 
possible  kind  of  a  discontinuity  of  C  is  a  jump.  Note  also  that  we  allow  C  to  have  a  "singular" 
component,  that  is  a  continuous  increasing  function  whose  derivative  is  zero  for  almost  all 
t.  The  famous  Cantor  function  is  an  example;  see,  for  example,  Royden  (1968,  p. 48).  The 
consumption  set  of  the  agent,  A'+,  is  the  space  of  all  such  functions  and  the  commodity  space, 
X,  is  the  linear  span  of  A'+.  Note  that  X  is  the  space  of  right-continuous  and  finite  variation 
functions.  Note  also  that  a  finite  variation  function  x  on  [0,T]  has  a  finite  left-limit  at  any 
t  e  (0,r]  denoted  by  x{t~)  and  a  finite  right-limit  at  any  t  6  [0,T')  denoted  by  x{f^).  By 
right-continuity,  for  any  i  G  A'  we  have  !(<■*")  =  x{t),  i  £  [0,T).  For  convenience,  we  will  use 
the  convention  that  x(0~)  =  0.  Since  left-limits  exist  for  any  a;  G  A",  a  jump  of  of  x  at  t  is 
Ax{t)  =  x{t)-x{i-). 

The  points  of  discontinuity  of  a  consumption  pattern  C  are  the  moments  when  the  agent 
decides  to  consume  a  "gulp",  and  the  size  of  the  jump  is  the  amount  of  that  "gulp".  Note  that 
there  can  be  only  at  most  a  countable  number  of  times  of  "gulps"  since  C  is  an  increasing  right 
continuous  function  of  time.  Let  these  moments  be  ri,r2,. . .,  and  let  the  jump  at  time  r,  be 

We  use  weak  relations  in  our  discussion.  Hence  increasing  is  equivalent  to  nondecreasing,  for  example.  When 
a  relation  is  strict,  we  will  explicitly  state  so. 
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AC(t,).  Moreover,  C  is  absolutely  continuous  on  the  intervals  on  which  the  agent  consumes  at 
rates  and  the  derivative  of  C  on  these  intervals,  denoted  c(t),  is  the  "rate"  of  consumption  there. 
When  this  derivative  is  zero,  C  is  constant  on  the  interval,  and  the  agent  is  not  consuming  at 
all. 

The  agent  starts  at  time  0  with  endowment  Vl^(O),  and  at  any  time  t  he  can  invest  part  of 
or  all  his  weaJth  in  a  riskless  asset  with  instantaneous  rate  of  return  r(<).  We  assume  that  the 
interest  rate  r(<)  is  a  continuous  function  of  time.  The  agent's  wealth  before  consumption  at 
time  t,  denoted  W{t)y  changes  according  to  the  following  dynamics: 

dW{t)     =     W{t)r{t)dt-dC{t)         fort  e  (r„r,+i)     for  all  i , 
W{t^)    =     W(T,)-ACiT,)        foraUr.. 

Note  that  W{t)  is  a  left  continuous  function  and  (1)  is  just  the  budget  constraint  over  time. 
We  impose  the  condition  that  W{t)  >  0  for  alH  6  [0,r]. 

The  agent  h«LS  preferences  for  consumption  over  the  period  [0,  T]  and  for  final  wealth  W{T).^ 
He  feels,  however,  that  consumption  at  one  time  is  a  substitute  for  consumption  at  other,  near- 
by times.  Therefore,  delaying  or  advancing  consumption  for  a  very  small  period  of  time  has  a 
very  small  effect  on  his  total  satisfaction.  Huang  and  Kreps  (1989),  for  the  case  of  certainty, 
and  Hindy  and  Huang  (1989),  for  the  case  of  uncertainty,  formalize  the  idea  that  consumption 
preferences  can  be  similar  to  those  expressed  by  the  agent.  In  particular,  the  authors  advance 
a  family  of  topologies  on  the  space  of  consumption  patterns  over  time  that  capture  the  notion 
that  consumptions  at  nearly  adjacent  dates  are  almost  perfect  substitutes.  In  this  paper,  we 
use  one  member  of  this  family  given  as  follows.  Fix  p  >  1.  Define  the  topology  T  on  the 
commodity  space  X  to  be  the  topology  generated  by  the  norm:^ 

\\C\\=[J^\C{tWdt  +  \CiT)\^]''\  (2) 

Moreover,  Huang  and  Kreps  (1989)  and  Hindy  and  Huang  (1989)  show  that  there  are 
intuitively  appealing  functional  forms  of  utility  which  express  preferences  for  consumption  with 
intertemporal  substitution  properties.  The  agent  has  one  of  them.  Fix  any  consumption  pattern 
C  and  a  corresponding  terminal  wealth  W{T).  At  any  time  t,  define  the  exponentially  weighted 


^The  astute  reader  might  have  observed  that  the  final  wealth  should  be  W(T'''),  since  wealth  is  a  left  con- 
tinuous function  of  time.  To  simplify  notation,  we  will  use  the  slightly  inaccurate  W{T)  for  final  wealth.  Our 
justification  is  that  consumption  gulps  at  T  add  nothing  to  the  satisfaction  of  the  agent.  Hence,  at  the  optimal 
solution  W(T)  =  U'(r+). 

*The  special  treatment  of  C(T)  in  the  norm  accounts  for  the  fact  that  two  consumption  patterns  which  agree 
on  [0,T)  but  disagree  on  T  could  not  be  distinguished  if  the  norm  were  without  the  term  involving  C{T). 


average  of  past  consumption,  z{t),  by: 

2(0  =  2(0- )e-^'  +  p  f  e-^('-)  dC{s) ,  (3) 

No- 
where z{0~)  >  0  is  a  constant  and  /?  is  a  weighting  factor.  Note  that  the  lower  limit  of 
the  integral  in  (3)  is  0~,  to  account  for  the  possible  jump  of  C  at  <  =  0,  and  that  z{t)  is  a 
right  continuous  function.  Moreover,  z  has  a  jump  exactly  when  C  does  and  z  has  a  singular 
component  when  C  does.  Also  observe  that  higher  values  of  /?  imply  higher  emphasis  on  the 
recent  past  and  less  emphasis  on  consumption  in  the  distant  past.  Note  also  that  the  average 
past  consumption  z{i)  changes  according  to  the  following  dynamics: 

dzit)     =     fi[dCit)  -  z{t)dt]         for<  e(r,,r,+i)     for  alii, 
z{Ti)     =     2(r-)  +  /3AC(r.)         for  all r,. 

Given  2(0"),  the  agent's  utility  for  the  consumption  pattern  C  and  final  wealth  W{T)  is 
given  by: 

U{z{0-),0;{C,W{T)))=   f    u{z{t),t)dt  +  V{WiT)),  (5) 

Jo 

where  both  u:  3R+  x  [0,r]  — >  3?  U  {— oo}  and  V:  §?+—►§(?  U  {— oo}  are  continuous  and  increasing 

functions.  Furthermore,  V  is  strictly  concave  and  u  is  strictly  concave  in  its  first  argument.  Note 

that  we  have  allowed  the  possibility  that  u  or  V  can  take  the  value  — oo  at  zero.  For  example, 

V(W^)  =  ^W°,  where  a  <  0.  The  function  u  is,  in  the  terminology  of  Arrow  and  Kurz  (1970), 

the  felicity  function  that  assigns  the  level  of  satisfaction  derived  from  past  consumption  and 

V  is  the  bequeath  function.    Preferences  given  by  (3)  and  (5)  are  continuous  in  the  product 

topology  generated  by  T  and  the  Euclidean  topology  on  Jf+;  see  Hindy  and  Huang  (1989), 

proposition  17. 

Starting  from  a  given  level  of  wealth,  each  consumption  plan  C  determines,  via  the  budget 

constraint,  the  value  of  terminal  wealth  W{T).  It  also  determines  for  every  time  t,  the  wealth 

W{t),  and  the  average  past  consumption  z{t~).    Note  that  at  any  t,  the  value  z{t~)  is  the 

average  past  consumption  up  tiU  t,  excluding  the  possible  consumption  at  t.  We  will  call  W{t) 

and  z{t~)  the  state  variables  at  t,  since  they  represent  the  status  of  the  agent  before  making  his 

consumption  decision  at  t.  The  agent  faces  the  problem  of  choosing  a  consumption  pattern  C* 

-  the  optimal  control  -  from  the  space  A'^.  -  the  admissible  controls  -  to  maximize  his  utility, 

U{z{0~),0;{C,W{T))),  subject  to  the  dynamics  given  in  (1)  and  (4),  and  given  that  his  initial 

wealth  is  1^(0)  and  given  2(0"). 


6  3     Heuristic  Derivation  of  Necessary  Conditions 

Formally,  let  A{W (0),0)  C  X+  x  JJ+  be  the  space  of  all  pairs  of  consumption  pattern  C  and 
final  wealth  W{T)  that  satisfy  the  budget  constraint  of  (1)  starting  with  H^(0).  The  agent's 
problem  is  to  find: 

sup  UiziO-),0;{C,W{T))).  (6) 

(c,w(r))e>(W(o),o) 

A  solution  to  (6)  exists  if  the  supremum  is  finite  and  is  attained  by  some  {C',W'{T))  G 

AiWiO),0). 

At  times,  we  will  also  consider  a  sub-problem  of  (6)  at  some  t  G  [0,r):  given  {C(s);5  G 

[0,<~]}  and  W{t)  determined  by  (1)  (the  budget  constraint),  solve 

sup  U(z{r),t;C',WiT))=   f    uiz{s),s)ds  +  V(WiT)),  (7) 

{C',W(T))eA{W{t),t)  Jt 

where  C  is  an  increasing  and  right-continuous  function  on  {t,T]  representing  accumulated 
consumption  starting  from  t  with  the  convention  that  C^{s)  =  0  for  all  .s  <  t,  where  A{W{t),t) 
denotes  the  consumption  pattern  C'  and  finaJ  wealth  W{T)  that  satisfy  the  budget  constraint 
(1)  on  [t,T]  with  an  initial  value  W(t),  where 

z{s)  =  z{t-)e-'^^'-'^  +   r  e-^^'-^UC\0     ioTs>t.  (8) 

It  is  clear  that  once  W{t)  and  z{t~)  are  known,  {C{s);s  G  [0,i~]}  has  no  impact  on  the  choices 
of  C  in  (7)  and  this  justifies  the  notation  U{z{t-),t-C^,W{T)).  Moreover,  if  {C',W'{T))  is 
a  solution  to  (6),  then  {C\s)  =  C'is)  -  C'(t~);5  G  [t,T]}  is  a  solution  to  (7)  with  z{t-)  and 
W{t)  corresponding  to  {C\W'{T)). 

3     Heuristic  Derivation  of  Necessary  Conditions 

We  now  use  heuristic  arguments  to  derive  a  set  of  necessary  conditions  for  a  solution  to  (6). 
These  conditions  will  imply  that  an  optimal  consumption  pattern  can  have  gulps  only  at  <  =  0. 
Suppose  (C,  W'{T))  is  an  optimal  solution  to  (6)  and  let  the  corresponding  wealth  and 
average  past  consumption,  or  the  state  variables,  be  {W'(t),z'{t~))  for  t  G  [O,^].  At  any  time 
t  and  starting  with  wealth  W{t)  and  average  past  consumption  z{t~),  let  the  value  function 
J{W{t),z(i~),t)  be  the  maximum  possible  attainable  satisfaction  over  the  remaining  period 
[t,T].  In  other  words,  let: 

rT 


JiW{t),z{t-),t)=  sup  [/    u{z{s),s)ds  +  ViW{T))], 

(C'W(T))eA(W(t),i)'-Jt  ' 


(9) 


where  {z{s);s  G  [^T]}  is  defined  according  to  (8). 

Assume  that  J  is  finite  and  differentiable  in  W  and  2.  The  marginal  value  of  wealth  at  time 
t,  Jw{W,z,t)  =  — an'^'  1  measures  the  changes  in  the  maximum  attainable  satisfaction  that 
results  from  a  very  small  change  in  wealth  when  everything  else  is  kept  constant.  Similarly,  the 
marginal  value  of  the  average  past  consumption  z  at  time  t,  Jz{W,z,t)  =  — g^^'^' ,  measures 
the  change  in  the  value  function  for  infinitesimal  changes  in  2,  ceteris  paribus. 

Along  the  optimal  solution,  J  should  satisfy  the  following  conditions: 

1  -  Bellman  Optimality  Principle 

The  Bellman  optimality  principle;  see,  for  example,  Fleming  and  Rishel  (1975),  implies  that  for 
all  times  t  and  r  €  [0,T]  such  that  <  <  r, 

JiW'{t),z'{t-),t)  =  f^    u{z'{s),s)ds  +  J{W'{T\z'{r-),r) .  (10) 

That  is:  an  optimal  policy  on  [t,  T]  remains  optimal  over  any  subperiod  [r,  T].  In  particular,  this 
principle  implies  that  along  the  optimal  solution,  the  value  function  J{W',  z',t)  is  a  continuous 
function  of  time  even  at  times  of  jumps.  Right-continuity  follows  from 

J{W'{t),z'{t-),t)  =  ]imJiW'{T  +  A),z'{t-  +  A),T  +  A)  =  J{W'{t+),z'{t),t)     for  all  r., 

(11) 
and  left-continuity  is  easy  to  see. 

For  brevity  of  notation,  we  will  use  J{t)  to  denote  J{W'{t),z'{t~),t)  and  similarly  use 

Jwit)  and  Jz{t)  to  denote  the  partial  derivatives  of  J{t)  with  respect  to  W  and  2,  respectively. 

2  -  Continuous  Marginal  Value  of  W  and  z 

Along  the  optimal  policy,  given  the  interest  rates,  the  marginal  value  of  e  units  of  wealth  at 
time  t  G  [0,7")  must  be  equal  to  the  marginal  value  of  eeJ'  ^^''  *  units  of  wealth  at  time 
t  +  At  for  small  A<  >  0  or  else  some  changes  in  C  will  be  called  for  to  change  W*  and  z'. 
That  is,  we  must  have 

7w{t)€  =  lw{t  +  At)€ef<^^''^'^'^'.  (12) 

Letting  A<  |  0,  we  get  Jvv(0  =  Jwif^)-  Thus  Jw{t)  must  be  right-continuous  on  [0,7').  Along 
the  same  line  of  arguments,  we  show  that  Jw{i)  must  be  left-continuous  on  (0,r]  and  thus 
Jwit)  is  continuous  on  [0,T]. 
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Similarly,  by  the  Bellman  optimality  principle,  a  marginal  value  of  e  increase  in  z{t~)  at  t 
must  be  equal  to  its  marginal  contribution  to  the  felicity  function  on  {t,t  +  A/]  and  to  the  value 
function  at  time  t  +  At.  That  is,* 

/t+At  _ 

u,{z'is),s)(e-^^'-'Us  +  J,{t  +  At)(e-^^\  (13) 

Letting  A<  — >  0,  we  conclude  that  J^CO  must  be  right-continuous  on  [0,T).  The  left-continuity 
of  J z{i)  is  established  by  noting  that 

Jt-At 
and  letting  A<  — >  0. 

3-  Dynamics  of  Marginal  Values 

By  the  hypothesis  that  r{t)  is  continuous  in  <,  (12)  implies,  as  At  — >  0,  that 

— j^ —  =  -T{t)Jw{t). 

Next  note  that  if  z'{i)  is  continuous  on  some  time  interval  {t  -  A<,t  -I-  A<),  then 


At 
and 


u,{z'it),t) 


Hence,  in  a  time  interval  over  which  C"  has  no  "gulps",  (13)  implies,  as  At  — »  0,  that 

^Ml  =  -u,{z'{t),t)  +  p7,{t). 

Also  note  that  at  <  =  T,  the  marginal  value  of  wealth,  Jw{T)  is  exactly  equjil  to  the 
derivative  of  V  evaluated  at  the  terminal  wealth  W'{T).  In  addition,  any  unit  of  the  good 
consumed  at  t  =  T,  with  no  change  in  wealth,  has  no  effect  on  the  agent's  total  satisfaction 
and  hence  J z{T)  =  0. 

4-  Appropriate  Times  for  "Gulps" 

Applying  Bellman's  optimality  principle  in  (10)  on  an  interval  (r,, r,+i)  when  our  solution 


*We  use  u,(r,  t)  to  denote  ^=^. 


prescribes  consumption  at  rates,  we  get  the  following  Bellman  equation: 

max{u{z'it),t)  +  Jw[rit)W'it)-c{t)]-i-J,(}[c{t)-z'it)]  +  7t}  =  0     for  all/  G  (r.,r,+i).  (15) 
c(<)    >■  J 

Note  that  the  Bellman  equation  is  linear  m  the  consumption  rate  c{t).  Hence,  the  consump- 
tion rate  that  satisfies  (15)  is  given  by: 

c{t)  =  0    when    Jw{t)  -  Plz{t)  >  0  , 

c(Oe[0,oo]    when     Jw{t)  -  Plzit)  =  0  , 

c{t)  =  oo    when     Jw{t)  -  Plzit)  <  0  . 

Bellman  equation,  therefore,  suggests  that  over  the  periods  in  which  consumption  is  at  rates, 
it  cannot  be  the  case  that  (/?  times)  the  marginal  value  of  z  is  greater  than  the  marginal  value  of 
W.  It  also  suggests  that  a  "gulp"  of  consumption  might  be  prescribed  at  any  moment  r  when 
Jwi''')  ~  PJzi''')  £  0-  Suppose  that  we  prescribe  a  "gulp"  at  r  when  Jwi''')  —  /^<^z(t)  is  strictly 
negative.  Since  the  marginaJ  values  of  W  and  z  are  continuous,  the  function  Jwii)  —  PJzi^) 
will  be  strictly  negative  on  an  interval  (t  -  e,T  +  e)  for  some  e  >  0.  Hence  our  candidate  policy 
should  prescribe  a  jump  for  all  points  t  G  (r  —  e ,  r  +  e).  Since  this  cannot  happen  as  there  can 
only  be  a  countable  number  of  jumps,  our  policy  might  prescribe  a  "gulp"  only  at  a  moment 
T,  on  this  particular  interval,  such  that  JwiT)  -  I3Jz{t)  =  0. 

5-  No  "Gulps"  after  t  =  0 

Now  suppose  that  our  policy  calls  for  a  "gulp"  of  size  A  at  time  r  >  0.  Note  that  by  right 
continuity  of  C,  we  cannot  have  two  successive  jumps  at  any  one  moment.  This,  together  with 
the  continiiity  of  the  marginal  values  of  W  and  z,  implies  that  there  are  two  strictly  positive 
numbers  €i,C2  such  that: 

Jwit)-0zit)>O       on       (r-ei,r), 
Jw{t)  -  PJzit)  =  0    when     <  =  r  , 
Jwii)-  (3Jz{t)>0      on       (r,r  +  e2). 

Assuming  that  Jw  and  Jz  are  differentiable  functions  of  time,  this  implies  that  Jw{t)  — 
PJzit)  is  decreasing  just  to  the  left  of  r  and  increasing  just  to  the  right  of  r.  This  condition, 
however,  cannot  hold  for  any  size  of  jump  A.  From  the  dynamics  of  Jw  and  J^,  we  get  that: 

|[7iv(r+)  -  /37.(T+)]  -  jpwir)  -  /37,(r)]  =  /3 \u,{z'(t)  +  I3A,t)  -  t..(z*(r), r)] .      (16) 
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But  by  strict  concavity  of  the  felicity  function  in  2,  this  last  quantity  is  strictly  negative.  Hence, 
if  ^{Jw  —  0J z]  were  negative  just  before  the  jump,  it  would  be  strictly  negative  just  after  the 
jump,  thus  violating  the  condition  that  Jw  —  PJz  be  increasing  just  after  a  "gulp".  Note  that 
our  analysis  is  not  valid  for  <  =  0  and  t  =  T,  thus  C*  does  not  have  any  gulps,  except  possibly 
at  <  =  0  and  t  =  T.  A  gulp  at  t  =  T,  however,  is  clearly  sub-optimal  since  the  agent  cannot 
derive  any  consumption  satisfaction  from  it  and  the  final  wealth  is  also  reduced. 

All  the  above  considerations  lead  us  to  conclude  that  C  should  take  the  form  of  a  possible 
"gulp"  at  <  =  0,  followed  by  periods  of  consumption  mixed  with  periods  of  no  consumption.  If 
we  should  prescribe  a  jump  AC*(0)  at  <  =  0,  then  the  size  of  the  jump  should  maximize  the 
vcdue  function  immediately  after  the  jump.  That  is,  the  jump  size  AC*(0)  should  solve  the 
following  problem 

max  J(W^(0)  -  e,z{0-)  +  /96,0+). 

From  the  first  order  condition,  we  then  know  that  Jw{0^)  =  f^Jzi^'^)-  Moreover,  after  the 
initial  possible  jump  at  <  =  0,  the  following  condition  should  be  satisfied  for  all  t  G  (0,T];  at 
times  of  no  consumption: 

u(z'{t),t)  +  Jwr{t)W'it)  +  l,fiz'{t)  +  7,  =  0,  (17) 

together  with 

/?7.(0-7h'(0<0,  (18) 

and  at  the  times  when  consumption  occurs  at  rates,  we  must  have 

iJwit)-l3'Jz{i)]c'{i)  =  Q.  (19) 

More  generally,  consumption  only  occurs  when  Jw{t)  —  PJz{i)-  During  these  times  the  strategy 
of  no  consumption  is  sub-optimal  and  hence 

u{z'{t),t)  -\-Jwrit)W'it)  +  J,0z'ii)  +7t  <  0.  (20) 

The  necessary  conditions  can  be  expressed  more  compactly  by  stating  that  the  value  function 
should  at  all  all  times  satisfy: 

mnxiu{z,t)  +  JwWr{t)-J^Pz  +  Jt,  0,  -Jw]  =  0.  (21) 

In  the  following  section,  we  provide  conditions  sufficient  for  a  candidate  solution  to  be  optimal. 
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4     Sufficiency 

The  necessary  conditions  in  (18)  and  (19)  simply  say  that  the  agent  should  adopt  a  consumption 
policy  of  a  possible  initial  "gulp"  followed  by  periods  of  consumption  mixed  with  periods  of  no 
consumption.  If  the  agent  starts  with  a  consumption  "gulp",  then  immediately  after  t  =  0,  the 
marginal  value  of  wealth  W  should  be  equal  to  (/?  times)  the  marginal  value  of  past  consumption 
z.  Otherwise,  it  would  benefit  the  agent  to  change  the  value  of  the  initial  "gulp". 

During  the  periods  in  which  the  agent  consumes  at  rates,  he  does  this  in  such  a  manner 
that  the  marginal  value  of  wealth  is  always  equal  to  (/?  times)  the  marginal  value  of  average 
past  consumption.  In  other  words,  the  agent  chooses  his  consumption  so  that  the  marginal 
value  of  any  additional  unit  of  the  good  at  any  time  is  equalized  between  the  two  competing 
uses  available  to  him,  namely  investing  to  increase  his  wealth  and  consuming  to  increase  his 
average  past  consumption.  If  this  condition  is  not  satisfied  in  a  particular  policy,  then  the  agent 
wiU  find  it  attractive  to  deviate  from  that  policy  by  reallocating  the  consumption  good  in  the 
activity  with  the  higher  marginal  value. 

When  the  agent  is  not  consuming,  it  must  be  the  case  that  the  marginal  utility  of  wealth  is  at 
least  as  large  as  (/?  times)  the  marginal  utility  of  the  average  past  consumption.  In  other  words, 
during  these  periods  the  agent  gains  more  in  overall  satisfaction  by  investing  all  his  wealth  in 
the  riskless  asset  and  by  temporarily  refraining  from  consumption.  The  increased  wealth  will 
provide  more  consumption  and  bequeath  value  in  the  future  than  immediate  consumption.  Of 
course,  when  the  marginal  values  of  the  good  in  both  uses  is  again  equalized,  the  agent  may 
start  consuming  again.  Finally,  the  necessary  conditions  instruct  the  agent  to  follow  a  policy 
such  that  at  any  moment  after  t  —  0,  the  marginal  value  of  the  good  if  consumed,  ^J z,  is  never 
strictly  greater  than  the  marginal  value  of  the  good  if  invested,  Jw- 

Note  that,  by  the  necessary  conditions,  when  consumption  occurs,  there  is  no  telling  whether 
it  is  at  "rates"  or  whether  it  includes  singular  components.  However,  the  reader  will  find  out 
later  that  the  closed  form  solution  we  construct  in  the  following  section  for  a  particular  felicity 
function  shows  that  the  optimal  consumption  policy  contains  no  singular  component. 

We  now  provide  sufficient  conditions  for  a  consumption  policy  to  be  optimal.  We  argue  in 
two  steps.  First,  we  show  that  there  is  a  value  function  J'{W,z,t)  which  is  an  upper  bound  on 
the  satisfaction  over  [t,T]  that  an  agent  can  obtain  starting  at  t  with  wealth  W  and  an  average 
past  consumption  z.  Second,  we  give  conditions  under  which  a  consumption  policy  achieves 
this  upper  bound  and  hence  it  is  indeed  the  optimal  policy. 
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Let  the  agent  at  any  time  t  have  wealth  W{t)  and  average  past  consumption  z{t~).  Assume 
that  the  agent  has  the  opportunity  to  exchange  his  wealth  and  average  past  consumption  for  a 
level  of  satisfaction  J'{W{t),z{t~),t).  In  other  words,  there  is  a  "utility  equivalent"  function 
J'{W,z,t)  defined  for  all  levels  of  wealth  and  average  past  consumption  and  for  all  times  in  [0,T] 
that  provides  the  agent  at  time  t  with  lump-sum  satisfaction  for  the  period  [t,T].  Therefore 
the  agent  has  the  option  of  choosing  any  budget  feasible  consumption  plan  till  any  time  t,  and 
then  exchanging  his  wealth  and  average  past  consumption  at  that  time  for  a  lump-sum  payoff 
in  units  of  utility.  We  will  show  that  if  J'{W,z,t)  satisfies  certain  conditions,  then  exchanging 
M^(0)  and  z{0~)  at  time  zero  for  J'{W{0),z{0~),0)  is  better  for  the  agent  than  adopting  any 
feasible  consumption  policy  till  any  time  t  and  then  receiving  a  lump-sum  utility  at  that  time. 

Consider  the  situation  in  which  the  agent  decides  to  terminate  his  consumption  at  time 
t  G  [0,T],  and  exchange  his  state  variables  at  t,  W{t)  and  z{t~),  for  J'{W{t),z{t~),t).  In  such 
a  case,  the  agent's  total  satisfaction  will  be  given  by: 

r  uizis),s)ds  +  r{W{t),z{r),t) .  (22) 

Jo 

To  ensure  that  the  value  in  (22)  is  the  correct  value  of  utility  for  all  possible  plans,  we  impose  the 
following  boundary  conditions  on  J'.  First,  note  that  the  agent  might  decide  not  to  terminate  a 
given  consumption  plan  at  all.  At  time  T,  he  would  receive  V{W{T))  and  his  total  satisfaction 
will  be  given  by  (5).  We  require  that  at  T,  J*(iy(r),z(T-),r)  =  V(M'(r)),  and  thus  the  value 
in  (22)  is  the  utility  for  a  consumption  plan  followed  completely  till  time  T.  Second,  note  that 
the  agent  might  follow  a  consumption  plan  that  exhausts  all  his  wealth  strictly  before  time  T, 
and  then  "live  on"  the  satisfaction  derived  from  past  consumption.  To  ensure  that  the  value 
given  by  (22)  is  the  corresponding  utility  from  such  a  plan,  we  impose  the  boundary  condition 
that  J'{0,z,t)  =  J^uiz€-^^'-^\s)ds  +  V{0). 

The  following  theorem  shows  that  the  agent  prefers  receiving  J'{W{0),z{0~),0)  to  the 
utility  gained  from  any  consumption  plan  terminated  at  ant  time  t  6  (0,T]. 

Theorem  1  Assume  that  there  exists  a  differentiable  function  J'{W,z,t):^+  X  5f+  X  [0,T]  — » 
J?  U  {  — oo},  concave  in  W  and  z,  whose  partial  derivatives  are  continuous  functions  of  time, 
that  satisfies  the  following  differential  equation: 

m^{u{z,t)-\-Jw^Vrit)-j;Pz  +  J^,pj;-j;v}  =  0    V<e[0,T],  (23) 

together  with  the  boundary  conditions: 

J'{W,z,T)     =     V{W)     and 
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J'{0,z,t)    =     /    u{ze-^^'-*\s)ds  +  V{0), 


then 

''  uiz(s),s)ds  +  J'{W{t),z{r),t)  <  r(WiO),z{0-),0)    yC  £  AiW{0),0), 


j: 


where  {z{s);0  ^  s  <  t  }  and  W{t)  are  the  average  past  consumption  and  time  t  wealth, 
respectively,  associated  with  C. 

Proof.   Assume  that  the  agent  adopts  a  consumption  plan  C  £  A(W{0),0)  that  terminates 

at  t,  and  let  the  points  of  discontinuity  of  C  on  (0,0  be  ti,T2, The  wealth  process  and 

the  average  past  consumption  associated  with  C  is  {H^(5);0  <  s  <  t)  and  {2(5);  0  <  z(s)  < 
t},  respectively.  Recall  that  W  is  left-continuous  and  z  is  right-continuous.  For  convenience 
of  notation,  we  at  times  denote  J''{W{t),z{t~),t),  J^{W{t),z(i-),t),  J^{W{t),z{t-),t),  and 
J^{W(t),z{t-),t)  by  J*(0,  Jwit)^  Jzit)i  and  j;(t),  respectively.  We  have 

f^uizis),s)ds  +  J'{W{t),z{t-),t) 
=     /o'  u{z{s),s)ds  +  J'(M'(0),z(0-),0) 

+  E.=o  f,r  {j'w{s)rWis)ds  -  Jty:s)dCis)  +  J:{s)l3{dC{s)  -  zis)ds)  +  J:{s)ds) 

(24) 
where  the  equality  follows  from  fundamental  theorem  of  calculus  and  we  have  set  tq  —  0. 
Note  that  the  boundary  conditions  for  J*  ensure  that  the  left-hand  expression  is  the  correct 
expression  of  utility  even  for  consumption  plans  that  do  not  terminate  before  T,  or  those  plans 
for  which  the  wealth  reaches  zero  strictly  before  T. 

By  the  hypothesis  that  J'  is  concave  in  its  first  two  arguments,  we  know  that 

<     Jwir^Wirt)  -  W{T,))  +  J;(r.)(z(r.)  -  z(r-)) 
=     Jw(r,){Cir-)  -  C(r.))  +  j;(r.)/?(C(r.)  -  C(7;-)). 

Substituting  this  into  (24)  gives 

fu{zis),s)ds  +  J'{W{t),z{t-\t) 
Jo 

<     J-(H^(0),2(0-),0)  +  f\u{z{s),s)  +  j;yis)Wis)r{s)  -  J:{s)0z{s)  +  J:{s)]ds 

Jo 
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+  r  [/?j;(s)  -  Jw{s)]dCis) 

Jo- 
<     J-(Vy(0),z(0-),0), 

where  the  second  inequality  follows  from  the  hypothesis  that  the  integrands  are  negative  and 
C  is  increasing.      I 

Now,  if  we  can  show  that  there  exists  an  actual  policy  {C'',W'(T))  6  A{W{0),0)  such  that 

U{ziO'),0;{C-,W'iT)))  =  J'{WiO),ziO-),0), 

then  {C',W'(T))  is  the  optimal  policy. 

In  fact,  we  will  prove  more  than  that.  In  the  following  theorem,  we  provide  a  characterization 
of  a  budget  feasible  policy  C,  starting  from  any  time  t  and  any  state  W(t),z{t~),  which 
guarantees  that  the  associated  value  function  is  equal  to  the  function  J'{W,z,t)  defined  in 
theorem  1. 

Theorem  2  Suppose  that  there  exists  a  differentiable  function  J'{W,z,t):^+  X  5?+  X  [0,T]  — ► 
3?  U  {  — oo},  concave  in  W  and  z,  whose  partial  derivatives  are  continuous  functions  of  time, 
which  solves  the  differential  equation: 

Tnax[u{z,  t)  +  JwWr{t)  -  J^jSz  +  j;,  fij;  -  J^]  =  0     Vi  G  [O.T] ,  (25) 

together  with  the  boundary  conditions: 

J'iW,z,T)    =     V{W)     and 
rT 


J'(0,z,t)     =      I    u(2e-^('-'\s)d5. 


Starting  from  any  time  t  6  [0,T],  with  W{t)  and  z{t~),  assume  that  there  exists  a  policy 
C  6  A{W(t),t),  which  is  continuous  on  {t,T],  with  a  possible  jump  AC'{t),  and  whose 
associated  state  variables  are  W'(t),z'{t~),  such  that  for  all  t  G  {t,T]: 


i: 


u{z',t)  +  j;vW'r{t)-j;Pz'  +  j;     =     0     and  (26) 

[j;y{W',z',t)-f3j;{W',z',t)]dC'{i)    =    0    for  all    e>0,  (27) 


ft 
and 

r(W{T),z{T-),T)  =  J'iWiT)  -  AC'{T),zir-)  +  0AC'iT),T)  ,  (28) 

then  U{z{t-),t-{C',W'{T)))  =  J'{W{t),z{t-),t)  for  all  {W{t),zit-),t)  e  §?+  x  Sf+  x  [0,T]. 
In  particular,  U{z{0-),0;{C',W'{T)))  =  J'{W{0),z{0-),0).  It  then  follows  from  theorem  1 
that  C  attains  the  maximum  of  U{z{0-),0;{C,W{T)))  over  the  set  A{W{0),0). 


15 

Proof.    Recall  from  the  definition  of  U{z{t-),t;{C' ,W'{T)))  that  for  r  <  t  <  s  <  T,  we 
have: 

Uiz'ir),t;iC',W'{T)))  =  J'  u{z-iO,Od^+U{z'{s-),s;{C',W'{T))).  (29) 

Now  consider  the  following: 

=   J'  u{z-{0,0  d^  +  J'iW'it'' ),  ^'(0,0  +  /'  (Jw  dw  +  j;  dz-  +  J^  di) 

=    J'{W{t^),z'it),t)  +  I'{uiz'i0,0  +  Jw^"{OriO  -  j:p^'io  +  Jl)  d^ 

+  J\(3J:{W',z\0-  Jw{W',z',0)dC'{0 
=     J'{W'it+),z'{t)J) 
=     J'{W'{t),z'{t-),t),  (30) 

where  the  first  equality  follows  from  the  fundamental  theorem  of  calculus.  The  second  equality 
foUows  from  the  dynamics  of  W  and  z'  and  the  assumption  that  C  is  continuous  on  {t,T], 
and  the  third  equality  follows  from  equations  (26)  and  (27).  The  last  equality  follows  from  the 
continuity  of  C  for  all  t  G  (TyT],  and  from  condition  (28),  when  t  =  t. 
From  equations  (29)  and  (30),  we  conclude  that  for  all  r  <  t  <  5  <  T, 

U{z'{r),t;iC',W'{T)))-U{z'{s-),s;{C',W'{T))) 
=     J'iW'{tlz\t-),t)-J'iW'{s),z'{s-),s)     or 

U(z'it-),t;{C',W'{T)))-  J'iW'{t),z'{t-),t)  =  m     for  all te  [t,T], 

where  m  is  a  constant  independent  of  t.  Now,  let  T  =  min{t  G  [0,T]:Vy*(<)  =  0},  where  we 
have  used  the  convention  that  if  the  minimum  does  not  exist,  we  set  the  minimum  to  be  T.  Note 
from  the  boundary  condition  on  J'  that:  J'{W'{t),z'{t-),t)  =  U{z-{t-),f;{C',W'{T))). 
Thus  we  conclude  that  m  =  0,  and  the  proof  is  now  complete.      I 

5     Optimal  Consumption  Policy 

We  provide  a  closed  form  solution  for  the  optimal  consumption  problem  formulated  in  section  2 
with  infinite  horizon  in  a  world  of  constant  interest  rate  r.    The  felicity  function  is  u{z,t)  = 
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-e~^^z° ,  where  q  <  1,  and  where  the  discount  factor  ^  >  0  captures  the  agent's  impatience.  In 
other  words,  the  agent  seeks  to  majcimize 

l/(r(0-),0,C)=    r  -e-^'z{tydi,  (31) 

Jo       Q 

given  W(0)  and  2(0")  and  where  z{t)  is  given  by  equation  (3).  The  sufficiency  theorem  for  this 
problem,  which  is  a  modified  version  of  theorem  2,  is  given  in  the  following  corollary,  whose 
proof  is  omitted. 

Corollary  1  Suppose  that  there  exists  a  concave,  continuously  differentiahle  function 
J*(H',  z):3?+  X  Jf+  — ♦  5f  U  {  — oo},  which  solves  the  differential  equation: 

max{—  +  J^yWr  -  J'Jz  -  6J',  pj;  -  J^]  =  0 ,  (32) 

together  with  the  boundary  conditions: 

roo  1 

J'(0,z)=   /      e-^'-{ze-^^'-'^)°ds     and  (33) 

Ji  Q 

lim  e-^'^J'iWiT),  ziT))  =  0  ,  (34) 

TToc 

for  all  feasible  policies.  Starting  from  any  time  t  £  [0,oo),  with  W{t)  and  z{t~),  assume  that 
there  exists  a  policy  C  €  A{W{t),t),  which  is  continuous,  with  a  possible  jump  AC'{t),  and 
whose  associated  state  variables  are  W'{t),z'{t~),  such  that  for  all  t  G  {t,oo): 


I 


—  +  JwWr  -  j;0z*  -6J'     =     0     and  (35) 

a 

\j;y(W',z\t)-PJ;{W',z',t)]dC\t)     =     0     forall    €>0,  (36) 


and 

J'{WiT),z{T-))  =  J'{W{t)  -  AC*(r),z(r-)  +  /?AC-(r)),  (37) 

then  U(z{t-),t;C')  =  J'{W{t),z{t-))  for  all  (Wit),z{t-))  €  R+  X  ^+. 

In  particular,  U{z{0-),0;C')  =  J'{W{0),z{Q-)).  It  then  follows  from  theorem  1  that  C  attains 

the  maximum  of  U{z{0-),0;C)  over  the  set  A{W{0),0). 

We  will  show  that  the  key  feature  of  the  solution  is  a  critical  ratio  A:*  >  0  of  wealth  li''  to 
average  past  consumption  z.  If  the  agent  starts  at  time  zero  with  ^,^1  strictly  less  than  k', 
then  the  optimal  behavior  is  to  invest  all  the  wealth  in  the  riskless  asset  and  wait  while  W 
increases  and  z  declines  till  the  ratio  ^  reaches  k' .  From  then  on,  the  agent  consumes  at  the 
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rate  which  keeps  the  ratio  ^  equal  to  k'  forever.  If,  on  the  other  hand,  the  agent  starts  with 
^(Q-\  strictly  greater  than  k',  then  the  optimal  behavior  is  to  take  a  "gulp"  of  consumption, 
reducing  W  and  increasing  z,  to  bring  ^  immediately  to  k* .  Following  this  gulp,  the  optimal 
consumption  occurs  at  the  rate  that  keeps  the  ratio  ^  equal  to  k'  forever.  The  critical  ratio 
k'  depends  on  the  interest  rate  r,  the  impatience  of  the  agent  captured  by  6,  the  concavity  of 
the  felicity  function  captured  by  q,  and  the  rate  of  decay  of  past  consumption  captured  by  /?. 
Our  construction  of  the  critical  ratio  k'  and  hence  the  optimal  solution  is  in  two  steps. 
First,  we  examine  candidate  solutions  of  the  k-ratio  form.  For  any  A;  >  0,  the  A:-ratio  policy 
is  the  policy  of  keeping  ^  equal  to  k  forever,  after  an  initial  "gulp"  if  ^,^_\  >  k,  or  after  a 
period  of  no  consumption  if  ^,^1  <  k.  We  will  show  that  the  value  function  associated  with 
any  k-ratio  policy,  denoted  j''{W,z),  satisfies: 

—  +  rWJl^  -  PzJ^  -SJ'^  =  0    if    —  <k     and 
a  z 

4,  -  /3 J*  =  0    if    —>k. 

Second,  we  show  that  there  is  a  unique  value  k'  >  0  such  that  the  associated  value  fu:iction, 
J'{W,z),  satisfies  the  differential  inequality 

maxi  —  +  j;^-rW  -  j;i3z  -  6J',  (3j;  -  J^  i  =  0  ,  (38) 

together  with  the  boundary  condition  that 

1      ^00  /  \  a  1 

JiO,z)  =  -         e-^'(ze-^')    dt=  '     ,,z°.  (39) 

It  then  follows  from  theorem  1,  that  the  ratio  policy  associated  with  k'  is  the  optimal  solution 
for  the  agent's  problem.  We  record  our  solution  in  the  following  statements. 

Assumption  1    The  parameters  of  the  problem  satisfy 

6  >  QT     and    (1  —  q)/3  >  ^  —  r . 

This  assumption  ensures  the  existence  of  a  solution  to  the  infinite  horizon  program.  It  rules 
out  the  case  when  the  agent  is  so  patient  that  he  prefers  to  wait  and  accumulate  wealth  for  the 
longest  possible  time.  This  behavior  leads  to  infinite  utility.  Now  fix  a  k-ratio  policy. 
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5     Optimal  Consumption  Policy 


Lemma  1  Suppose  that  ^,^1  =  k.    The  consumption  rate  required  to  keep  -^^  =  k  for  all 


t>  0  is 


and  the  corresponding  utility  is 


'»  =  Bm'^^'^ 


z{o-r 


"•^-"/^IStt) 


Proof.  Using  the  dynamics  of  W  and  z,  and  equating  -^i^)  to  zero,  we  can  compute  c. 
Another  simple  computation  produces  the  associated  utility.  Note  that  by  assumption  1,  the 
total  utility  is  strictly  positive.      I 

Lemma  2  Suppose  that  ^,J_    <  k.   Consider  the  policy  of  no  consumption  till  t'  when   ^A'./  = 
k,  and  then  consuming  to  keep  the  ratio  -^tM  =  k,  for  t  >  t' .   The  total  utility  from  this  policy 


IS 


zio-r  ^^(o-r[H^(o)i^ 


o{6  +  al3)  a       \.kz{0-)i  ]^s  -  aP{^)       S  +  a0 


(40) 


Proof.     The  reader  can  easily  verify  that  t'  =  log    ^j^J 
establishes  the  lemma.      I 


r+0 


.    A  direct  computation 


Proposition  1    The  value  function  j''(W,z)  associated  with  any  A;-ratio  policy  is  given  by: 


where 


j''{W,z)=  < 


+  ^ 


w 


a{6+Q0)  ^    a    [k: 

l(i±M.YB 


Has 


w 


A     iff<k 
w 


A    = 
B    = 


^-"/^(fel)      *  +  "^ 


and 


^-"/?(^) 


Furthermore,  j''  is  continuous,  concave,  has  continuous  first  derivatives  and  satisfies 

^  +  rWJl^  -  PzJ^  -6J''  =  0     if    ^<k, 
Ji^-PJ^  =  0     if    ^>k, 


(41) 
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together  with  the  boundary  condition 


a 


•^(0,2)  =  —r-^ — ttz    . 


w 


Proof.    Suppose  that  -^  >  '^^   The  size  of  the  initial  "gulp"  required  to  bring  the  ratio 

immediately  to  k  is 

W  -kz 

l  +  0k  ' 
and  we  define  j''{W,z)  =  J^{W  -  A,z  +  /3A).  Concavity  of  J*  in  both  W  and  z  follows  from 
assumption  1,  and  the  rest  of  the  proposition  can  be  ezisily  verified  by  direct  computations.      I 

This  proposition  shows  that  any  ratio  policy  has  a  value  function  which  satisfies  the  differ- 
ential equations  (41)  in  the  relevant  parts  of  the  domain.  The  value  function  of  the  optimal 
solution,  however,  satisfies  the  differential  inequality  (38)  over  the  whole  domain.  There  is 
exactly  one  value  k'  that  produces  the  optimcd  policy. 


Proposition  2  Let 

k'  = 


^  +  (l-a) 


6  —  ar 

and  note  that  k'  >  0  by  assumption  1.   The  value  function  J'  associated  with  the  k' -ratio  policy 
is  continuous,  concave,  has  continuous  first  derivatives  and  satisfies  the  differential  inequality: 

maxJ  —  +  J^rrW  -  J'^z  -  6J',  pj;  -  J^  I  =  0 , 

together  with  the  boundary  condition  that 

1 


J{0,z)  = 


q(q/?  +  <5) 

It  then  follows  from  theorem  1,  that  the  A;' -ratio  policy  is  the  optimal  solution  for  the  agent's 
problem. 

Remark  1   k'  is  the  unique  ratio  with  the  property  that  the  associated  value  function  J'  is 
twice  continuously  differentiate  over  the  whole  domain  {W,z). 

Proof.   In  light  of  proposition  1,  we  only  need  to  prove  that 

z°  W 

—  +  Jw'tW  -  J'(3z  -6J'  <0    if    —>k'     and 

a  z 

W 

pj;  -  Jw  <  0  if  —  <  fc* . 
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5     Optimal  Consumption  Policy 


To  prove  the  first  inequality,  consider  any  point  x  =  {W,z)  such  that  W  >  k'z.    Referring 

to  Figure  1,  let  fi  be  the  point  on  the  intersection  of  the  line  W  =  k'  z  and  the  straight  line 

passing  through  the  point  x  with  slope  ^^  =  -  4.  In  other  words,  g  is  the  point  on  the  boundary 

W  =  k*z,  to  which  one  would  jump  if  one  starts  at  x.  By  construction,  J'{x)  =  J'{q)- 

Let 

f{W,z)=—^J'wTW-J'Jz, 
a 

and  note  that  /(a)  —  6J'{a)  =  0.    Applying  the  fundamental  theorem  of  caJculus  along  the 
straight  line  connecting  a  and  i,  we  obtain 


/(x)-/(a)=   fUwdW  +  f^dz). 

Ja 


Noting  that  along  the  line  connecting  a  and  x,  we  have  dz  =  -jSdW,  and  that  dW  >  0  in  the 
direction  from  a  to  i,  it  then  follows  that  fw  —  (ifz  <  0  is  sufficient  to  conclude  that 

—  +  Jw^^  -  J'zP^  -Sr  <0    if    —>k'. 

a  z 

Computing  fw  -  Pfz  in  the  region  W  >  k'z,  the  reader  can  easily  verify  that  fw  -  Pfz  <  0 

O—  QT 

To  prove  the  second  inequality,  consider  the  function  J^-PJ^  in  the  region  where  W  <  k'z. 
We  can  write 

.k'z , 


r^-HJ:     =     z'^-'gi''^)     where 


y    '•+^  - 


aP  +  S 


+  P  I  r  +  /3 

where  A  is  given  in  proposition  1.  Note  that  5(1)  =  0,  and  that  1  -  ^^^  >  0,  by  assumption  1, 
hence  g{y)  j  00  as  y  |  00. 

Computing  the  derivative  of  p,  we  get 

P{8  -  ar) 


da       AU ->r  aP)    _<±££ 
dy  r  +  P      " 


\k'       k'{r  +  P))        y{P  +  r) 

Substituting  k'  in  the  expression  for  ^,  we  conclude  that  j^  =  0  for  j/  =  1,  and  that  ^  >  0 
for  y  >  1.  It  then  follows  that  J^,  -  PJI  >  0,  for  all  points  (W^z)  such  that  W  <  k'z.      I 

We  have  thus  shown  that  the  nature  of  the  optimal  consumption  policy  is  exerting  control 
over  the  ratio  of  wealth  to  average  past  consumption  to  keep  it  at  or  below  a  critical  level.  Any 
policy  of  keeping  the  ratio  at  or  below  a  fixed  constant  satisfies  many  of  the  sufficient  conditions 
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for  optimality.     However,  the  differential  inequality  (38),  which  is  the  crucial  condition,  is 
satisfied  by  only  one  critical  ratio  k* .  We  summarize  the  solution  in  the  following  proposition. 

Proposition  3   The  optimal  solution  is  to  consume  at  rate  c*{t)  =  \'_^JW(t),  after  an  initial 
gulp  of  size  A  =  (ir^ffTf^  [(^  -  ar)W{0)  +  (i^  +  (1  _  q))^(0-)]  ,  if  ^^  <  k' ,  or  after  a 


k'z(0- 


r+e     -fWiox 


period  of  no  consumption  of  length  t*  =  log     y^,L> '   ''     ,  if  ^,J_(  >  k' . 

It  is  interesting  to  compare  this  consumption  policy  to  that  adopted  by  a  consumer  who 
starts  with  the  same  initial  wealth  W{0)  and  the  same  past  consumption  experience  ^(0")  who 
seeks  to  maximize: 


/     e-^*c{t)''dt, 
Jo 


where  we  assume  that  6  >  ar  and  1  —  a  >  0.  It  can  be  easily  verified  that  his  optimal 
consumption  rate  is  c*(t)  =   il^'^^a  (0- 

The  propensity  to  consume  is  the  same  for  agents  with  time- additive  and  non-time-additive 
preferences.  However,  the  quantity  of  consumption  and  the  trajectory  of  wealth  are  differ- 
ent. Consider  the  case  when  S  =  r.  An  agent  with  time-additive  preferences  will  consume 
c*  =  rW^{t),  and  hence  his  wealth  at  any  time  will  be  a  constant  equal  to  his  initial  wealth, 
see  figure  2.  A  consumer  with  non-time  additive  preferences,  however,  will  either  start  by  con- 
suming a  "gulp"  of  size  - — ^-jzP — K  if  Ws  wealth  is  too  high  relative  to  z{0~),  and  then  keep 
the  level  of  his  wealth  constant  forever,  or  he  will  wait  for  t'  =  ;^  log  ^^p^  ,  if  his  wealth  is 
too  low  relative  to  ^(0"),  and  then  start  consuming  the  interest  on  his  wealth  forever. 

The  parameter  0,  which  controls  the  rate  of  "decay"  of  previous  consumption,  determines 
the  size  of  the  initial  "gulp"  or  the  length  of  the  initial  waiting  period,  and  hence  the  level 
of  the  subsequent  constant  wealth.  The  higher  the  value  of  /3,  the  smaller  the  size  of  the 
inital  gulp,  if  the  solution  calls  for  a  "gulp",  and  the  shorter  the  initial  waiting  period,  in 
case  the  solution  entails  a  waiting  period.  This  is  an  intuitive  result  since  a  higher  /3  implies 
that  past  consumption  experience  has  "smaller"  effect  on  current,  and  hence  total,  satisfaction. 
Therefore,  when  the  optimal  solution  entails  an  initial  waiting  period  to  accumulate  wealth,  the 
effect  of  ^(0")  decays  faster  with  higher  /?  leading  to  shorter  waiting  period  before  the  ratio  — 
reaches  its  critical  value.  Similarly,  when  the  optimal  solution  calls  for  an  initial  "gulp",  higher 
0  means  that  the  effect  of  the  "gulp"  wiU  decay  faster  and  hence  the  "gulp"  contributes  less  to 
future  satisfaction.  Therefore,  agents  with  higher  /?  choose  smaller  initial  "gulps". 
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6  Concluding  Remarks 

In  this  paper,  we  have  provided  sufficient  conditions  for  a  consumption  policy  to  be  optimal  for 
a  class  of  time-nonseparable  preferences  that  treat  consumptions  at  nearly  adjacent  dates  to  be 
almost  perfect  substitutes.  We  demonstrated  our  general  theory  by  explicitly  solving  in  closed 
form  the  optimal  consumption  policy  for  a  particular  felicity  function. 

The  heuristically  derived  necessary  conditions  for  optimality  in  Section  3  can  be  justified 
rigorously.  We  refer  the  reader  to  Blaquiere  (1985)  for  details.  We  also  remark  that  our 
conclusion  that  the  optimal  consumption  policy  does  not  involve  any  "gulps"  after  t  =  0 
depends  crucially  on  the  assumption  of  continuous  interest  rates.  If  the  interest  rate  is  not 
a  continuous  function  of  time,  a  different  consumption  policy  with  intermediate  gulps  might  be 
optimal. 

Finally,  we  remark  that  the  closed  form  solution  we  report  in  section  5  can  be  developed 
differently.  Observing  that  the  objective  functional  is  homogeneous  of  degree  a  in  z,  and 
that  the  dynamics  of  W  and  z  are  linear,  we  can  write  J'{W,z)  =  z°'h'{^),  for  some  function 
h':  3?+  -♦  K.  Substituting  this  form  of  J*  into  inequality  (  32),  we  obtain  an  ordinary  differential 
inequality  that  can  be  solved  and  the  criticaJ  ratio  k'  can  be  determined  by  imposing  the 
condition  that  the  solution  of  the  differential  inequality,  /i*,  is  a  twice  continuously  differentiable 
function.  We  elected  to  present  our  step-by-step  construction  of  the  candidate  solutions  and 
the  optimal  policy  to  illustrate  more  clearly  the  nature  of  the  control  problem. 
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The  State  Space  showing  the  Boundary  B. 
For  all  times  after  t=0,  the  optimal  policy 
restricts  the  state  to  the  admissible  region  O. 
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Time 
Trajectory  of  wealth  along  the  optimal  path  for 

time-additive  and  non-time-additive  preferences  assuming 
6      =       r        ,      pi       >     P2 


Figure  2 
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